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Abstract 

It is well known that there is a one-to-one correspondence between the entropy vector of a collection 
of n random variables and a certain group-characterizable vector obtained from a finite group and n 
of its subgroups [1]. However, if one restricts attention to abelian groups then not all entropy vectors 
can be obtained. This is an explanation for the fact shown by Dougherty et al [2] that linear network 
codes cannot achieve capacity in general network coding problems (since linear network codes form an 
abelian group). All abelian group-characterizable vectors, and by fiat all entropy vectors generated by 
linear network codes, satisfy a linear inequality called the Ingleton inequality. In this paper, we study the 
problem of finding nonabelian finite groups that yield characterizable vectors which violate the Ingleton 
inequality. Using a refined computer search, we find the symmetric group 5*5 to be the smallest group that 
violates the Ingleton inequality. Careful study of the structure of this group, and its subgroups, reveals 
that it belongs to the Ingleton-violating family PGL{2,p) with primes p > 5, i.e., the projective group 
of 2 X 2 nonsingular matrices with entries in Fp. This family of groups is therefore a good candidate for 
constructing network codes more powerful than linear network codes. 

I. Introduction 

Let A/" = {1, 2, ... , n}, and let Xi,X2, . . . , Xn be n jointly distributed discrete random variables. For 
any nonempty set a C J\f, let Xa denote the collection of random variables {Xi : i G a}, with joint 
entropy K = H{Xa) = H{Xi; i E a). We call the ordered real (2" - l)-tuple {ha : 9 7^ a C J\f) e 
an entropy vector. The set of all entropy vectors derived from n jointly distributed discrete random 
variables is denoted by F* . It is not too difficult to show that the closure of this set, i.e., F* , is a convex 
cone. 

The set F* figures prominently in information theory since it describes the possible values that the joint 
entropies of a collection of n discrete random variables can obtain. From a practical point of view, it is of 
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importance since it can be shown that the capacity region of any arbitrary multi-source multi-sink wired 
network, whose graph is acyclic and whose links are discrete memoryless channels, can be obtained by 
optimizing a linear function of the entropy vector over the convex cone F* and a set of linear constraints 
(defined by the network) [3], [4]. Despite this importance, the entropy region T* is only known for 
n = 2, 3 random variables and remains unknown for n > 4 random variables. Nonetheless, there are 
important connections known between F* and matroid theory (since entropy is a submodular function 
and therefore somehow defines a matroid) [5], determinantal inequalities (through the connection with 
Gaussian random variables) [6], and quasi-uniform arrays [7]. However, perhaps most intriguing is the 
connection to finite groups which we briefly elaborate below. 

A. Groups and Entropy 

Let G be a finite group, and let Gi, G2, . . . , Gn be n of its subgroups. For any nonempty set a C A^, 
the group Ga — Hi^aGi is a subgroup of G. Let \K\ be the order (cardinality) of a group K, and define 
ga = log We call the ordered real (2" - l)-tuple (^a : / a C AA) G M^""! a (finite) group 
characterizable vector. Let T„ be the set of all group characterizable vectors derived from n subgroups 
of a finite group. 

The major result shown by Chan and Yeung in [1] is that F* = cone(T„), i.e., the closure of F* is 
the same as the closure of the cone generated by T„. In other words, every group characterizable vector 
is an entropy vector, whereas every entropy vector is arbitrarily close to a scaled version of some group 
characterizable vector. 

To show that every group characterizable vector is an entropy vector [1] gives the following construc- 
tion. Let A be be a random variable uniformly distributed on the elements of G. Now for i = 1, . . . , n 
define Xi = AGi (the left coset of A in G w.r.t. the subgroup Gj). Then a simple calculation shows 
that ha = log = Qa, implying that every group-characterizable vector is an entropy vector. Showing 
the other direction, i.e., that every entropy vector is arbitrarily close to a scaled version of a group- 
characterizable vector is more tricky (the interested reader may consult [1] for the details). Here we shall 
briefly describe the intuition. 

Consider a random variable Xi with alphabet size and probability mass function {pi, f = 1, . . . , A^}. 
Now if we make T copies of this random variable to make sequences of length T, the entropy of Xi is 
roughly equal to the logarithm of the number of typical sequences. These are sequences where Xi takes 
its first value roughly Tpi times, its second value roughly Tp2 times and so on. Therefore assuming that 
T is large enough so that the Tpi are close to integers (otherwise, we have to round things) we may 
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roughly write 

1 / T 

\ Tpi Tp2 . . . TpTv-i 
where the argument inside the log is the usual multinomial coefficient. Written in terms of factorials this 
is 

If we consider the group G to be the symmetric group St, i e., the group of permutations among 
T objects, then clearly |G| = Tl. Now partition the T objects into N sets each with Tpi to Tp^ 
elements, respectively, and define the group Gi to be the subgroup of St that permutes these objects 

while respecting the partition. Clearly, |Gi| = {Tpi)\{Tp2)\ ■ ■ ■ {Tp^)], which is the denominator in ([T]). 

1 \G\ 

Thus, H{Xi) ^ y log so that the entropy is a scaled version of the group-characterizable g{i}- 
This argument can be made more precise and can be extended to n random variables — see [1] for the 
details. We note, in passing, that this construction often needs T to be very large, so that the group G 
and the subgroups Gi are huge. 

B. The Ingleton Inequality 

As mentioned earlier, entropy satisfies submodularity and therefore, with some care, defines a matroid. 
Matroids are defined by a ground set and a rank function, defined over subsets of the ground set, that 
satisfies submodularity. They were defined in a way to extend the notion of a collection of vectors (in 
some vector space) along with the usual definition of the rank. A matroid is called representable if 
its ground set can be represented as a collection of vectors (defined over some finite field) along with 
the usual rank function. Determining whether a matroid is representable or not is, in general, an open 
problem. 

Let 71 = A, Af = {1, 2, 3, 4}. In 1971 Ingleton showed that the rank function x^.y of any representable 
matriod must satisfy the inequality [8] 

Xl2 + Xi3 + Xi4 + X23 + X24 > Xi + X2 + X34, + X123 + X124 (2) 

where for simplicity we write Xij and Xijk for x^^ jy and Xjj fc}, respectively. However, it turns out 
that there are entropy vectors that violate the Ingleton inequality [9], so that entropy is generally not 
a representable matroid. Using non-representable matroids, [2] constructs network coding problems that 
cannot be solved by linear network codes (since linear network codes are, by definition, representable). 



As r* = cone(T„), we know there must exist finite groups, and corresponding subgroups, such that 
their induced group-characterizable vectors violate the Ingleton inequality. In [10] it was shown that 
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abelian groups cannot violate the Ingleton inequality, thereby giving an alternative proof as to why linear 
network codes cannot achieve capacity on arbitrary networks — they form an abelian group. So we need 
to focus on non-abelian groups and their connections to nonlinear codes. 

Finally, we remark that, in the context of finite groups, the Ingleton inequality can be rewritten as 

1^111(721103411^1231101241 > |Gi2 1 |Gi3 1 1 G14 1 1 G23 | IG24 | (3) 

C. Discussion 

Since we know of distributions whose entropy vector violates the Ingleton inequality, we can, in 
principle, construct finite groups whose group-characterizable vectors violate Ingleton. Two such dis- 
tributions are Example 1 in [11], where the underlying distribution is uniform over 7 points and the 
random variables correspond to different partitions of these seven points, and the example on page 1445 
of [12], constructed from finite projective geometry and where the underlying distribution is uniform over 
12 X 13 = 156 points. Unfortunately, constructing groups and subgroups for these distributions using the 
recipe of section IPAl results in T = 29 x 7 = 203 and T = 23 x 156 = 3588, which results in groups 
of size 203! and 3588!, which are too huge to give us any insight whatsoever. 

These discussions lead us to the following questions. 

1) Could the connection between entropy and groups be a red herring? Are the interesting groups too 
large to give any insight into the problem (e.g., the conditions for the Ingleton inequality to be 
violated)? 

2) What is the smallest group with subgroups that violates the Ingleton inequality? Does it have any 
special structure? 

3) Can one construct network codes from such Ingleton-violating groups? 

In this paper we address the first two questions. We identify the smallest group that violates the Ingleton 
inequality — it is the symmetric group ^5, with 120 elements. Through a thorough investigation of the 
structure of its subgroups we conclude that it belongs to the family of groups PGL{2,p), with p a prime 
greater than or equal to 5. {PGL{2, 5) is isomorphic to S^.]^ We therefore believe that the connection 
to groups is not a red herring and that there may be some benefit to it. 

The explicit nature of PGL{2,p) may lend itself to effective network codes. We only mention that 
non-abelian groups allow for much more flexibility in the design of codes. For example, if the incoming 

'GI/(2,p) is the general linear group of invertible 2x2 matrices with entries in Fp. PGL{2,p) is the projective general 
linear group, where proportional matrices in GL{2,p) are all mapped to the same element. 
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messages to a node in the network, a and b, say, are elements from a nonabelian group then the operations 
a'^b, aba, ba^, say, can potentially all correspond to different elements in the group, whereas in the abelian 
case they all coincide with a^b. Therefore nodes in a network will have much more choices in terms 
of what to transmit on their outgoing edges — and this should, ostensibly, be what allows one to achieve 
capacity. The drawback is, of course, that decoding becomes more complicated than solving a system of 
linear equations. 

We shall not say anymore about codes. What we will do in the remainder of the paper is to describe 
how we found the smallest Ingleton-violating group and how we uncovered its structure. This required the 
identification of conditions beyond being abeUan that force a group to respect Ingleton. It also required 
a deep study of the 120 element group that we found via computer search. We now present the details. 

II. Notation 

We use the following abstract algebra notations throughout this paper: 



|G| : the order of group G. 

G = H : the group G is isomorphic to the group H. 

H < G, H < G : H is a. subgroup of G, and a proper subgroup of G. 

H < G : if is a normal subgroup of G. 

G/H : the set of all left cosets of subgroup H in G. When H < G, G/H is a group. 

(Factor or quotient group) 
1^1 : the order of element g - smallest positive integer m s.t. (7™ = 1. 

: the conjugate of element x by element g in G: x^ = g~^xg. 

(No confusion with the powers of x as g is an element of G.) 
: the conjugate of subset X by element g in G: X^ = {x^ : x G X}. 
HK : the "set product" of H,K Q G: HK = {hk : h (£ H, k £ K}. 

H "A K : the semidirect product of groups H and K. 

{gi, . . . , gm), {S) : the group generated by the elements 171, ... , gm, and by the set S. 

G = {S\R) : {S\R) is a presentation of G. 5" is a set of generators of G, while i? is a set 

of relations G should satisfy. 
1 : the natural number "1", identity element of a group, or the trivial group. 

The meaning should be clear in different contexts with no confusion. 
Z„ : the integers modulo n = the cyclic group of order n. 

Sn : the symmetric group of degree n - all permutations on n points. 
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D2n 



the dihedral group of order 2n. 



GL{n,q) 



the finite field of q elements. 



the multiplicative group of units of Z„, and of ¥q.¥^- all nonzero elements of Fg. 
the general linear group of all invertible n x n matrices with entries from ¥g. 
The identity element for GL{n, q) is usually denoted by / = identity matrix. 



PGL{n,q) : the projective general linear group = GL{n,q)/V, where V - all nonzero scalar 



Designing a small admissible structure for the group G and its subgroups without an existing Ingleton- 
violating instance is very difficult, so we use computer programs to search for a small instance. We 
use the GAP system [13] to search its "Small Group" library, which contains all finite groups of order 
less than or equal to 2000 except 1024. We pick a group in this library, find all its subgroups, then test 
Ingleton inequality for all 4-combinations of these subgroups. This is a tremendous task, as there are 
already more than 1000 groups of order less than or equal to 100, each of which might have hundreds 
of subgroups (some even have more than 1000). 

It was therefore extremely critical to prune our search. In fact, we used the following "negative 
conditions", each of which guarantees that Ingleton is never violated. 

Condition 1: G is abelian. [10] 

Condition 2: Gt < G, Vi. [14] 

Condition 3: G1G2 = G2G1, or equivalently G1G2 < G. 

Proof: (sketch) Construct random variables Xj's from uniformly distributed A on G as in Section lPAl 
As Gi;2 = G1G2 < G, we can similarly construct random variable Xi-2 = ^Gi-2- Note that |Gi;2| = 



|G'i||G2|/|Gi2|, H{Xi.2\Xi) = H{Xi.2\X2) = as Gi,G2 < Gi;2. Similar to the proof of Condition |2] 
in [14], we use the following information inequality in [15]: 



Plugging in A = Xi, B = X2, G = X3, D = X4 and E = Xi-2 one can easily deduce Ingleton 



Remark 1: Condition |2] subsumes Condition [H while Condition [3] subsumes Condition |2] 
Remark 2: In the proof of condition [3] we used the aforementioned group-entropy relation to translate 
the problem to the entropy domain. We shall prove most of the conditions in this manner. 



matrices = {al : a G F^}. 



III. Computer Search and Some Negative Conditions 



2H{E\A) + 2H{E\B) + I{A; B\C) + I{A; B\D) + /(G; D) > H{E). 



inequality. 
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Observe that the Ingleton inequahty has symmetries between subscripts 1 and 2 and between 3 and 
4, i.e. if we interchange the subscripts 1 with 2 or 3 with 4, the inequality stays the same. Thus if 
we prove some conditions for some i € {1,2} and j € {3,4}, we automatically get conditions for 
all G {(1,3), (1,4), (2,3), (2,4)}. So without loss of generality, we will just prove conditions for 
i G {1,3}, or S {(1, 2), (1, 3), (3, 1), (3, 4)} when these symmetries apply. 
Condition 4: Gj = 1 or G, for some i. 

Proof: For i = I, either would imply G1G2 = G2G1 in Condition |3] For i = 3, \Gs\ = 1 implies 
that the Ingleton inequality becomes |Gi 11021101241 > 101211014110241, which clearly follows from 
|Oi||Oi24| > IO12IIO14I (implied by submodularity of entropy) and IO2I > IO24I. ■ 
Condition 5: Gi = Gj for some distinct 

Proof: (sketch) For = (1,2), use O1O2 = O2O1 in Condition S For (1,3) and (3,4), the 

argument is similar to that of the previous condition. ■ 
Condition 6: O12 = 1. 

Proof: Realize that Ingleton inequality for entropy vectors can be rewritten as 

?^13,14 + '"23,24 + ?'134,234 " ?'123,124 > 0, (4) 

where r^,/? = K + h/s- hanp - Kvjp for / a, /3 C J\f. (e.g., ri34,234 = /ii34 + /i234 - /i34 - /ii234-) 
By submodularity, all ,g > 0. If O12 = 1, then ri23,i24 = and @ holds. ■ 

Condition 7: Gi < Gj for some distinct 

Proof (sketch) = (1,2) implies O1O2 = O2O1. (1,3) implies ri23,i24 = in ©. (3,1) 

implies ri23,234 = ^ ri23,234 < ?-i2,24 =^ r-123,124 < ?"23,24 ^ ® hoMs. For (3,4), rewrite /113 = his4, 
^23 = /1234, hi23 = /ii234, then use submodularity and non-negativeness of entropy. ■ 

Remark 3: Conditions |6] and |7] were first pointed out to us by Prof. M. Aschbacher using group theoretic 
techniques. The proof presented above is based on the submodularity and non-negativity of entropy. 

Remark 4: Conditions [T] [3] and [6] are crucial in our searching program, as they appear in the outer 
searching loops and can reduce a large amount of work. 

IV. The Smallest Violation Instance and Its Structure 

Using GAP we found the smallest group that violates Ingleton is O = ^5. There are 60 sets of violating 
subgroups if we eliminate the influence of subscript symmetries. Furthermore, these 60 sets of subgroups 
are all conjugates of each other. Thus in terms of group structure, these instances are virtually the same. 
We list below some information from GAP about one representative: (the permutations are written in 
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cycle notation, e.g. (3, 4, 5) is the permutation that maps element 3 to 4, element 4 to 5, and element 5 
to 3). 

Gi = ((3,4,5),(1,2)(4,5)) 
G2 = ((1,2, 3, 4, 5), (1,4, 3, 5)) 
((2,3), (1,3,4,2)) 



= 53^1)6 



6 

20 



((2,4), (1,2,5,4)) 
= ((1,2)(3,5)) 
= ((1,2)(3,4)) 
= ((1,2)(4,5)) 
= ((1,3,4,2)) 
= ((1,2,5,4)) 
= 1 
= 1 



^8 
Z4 



Gi2llG'i3l|Gi4llG'' 



•^23 



IGil = 
IG2I = 

1^31 = 
IG4I = 
1^12! 

IG'is! 

1^14 1 
1^23! 
1^24! 
1^341 

1^123! = 1 
1^124! = 1 

11^24!, Ingleton is violated. Also 



2 
2 
2 
4 
4 
1 



G3 = 
G4 = 

G12 = 

Gi3 = 
Gi4 = 

G23 = 
G24 = 
G34 = 
G123 
G124 = 1 

As IG1IIG2IIG34IIG123IIG124I = 120 < 128 
Gi — G4 generate G = 55. 

To illustrate the structure of these subgroups, we use the group cycle graph. See FiglU where the 
dash-dotted lines denote the pairwise intersections of subgroups excluding identity. From the cycle graph 
we can obtain more structural information which GAP does not show us directly. First, not only is G2 
a semidirect product of two cyclic groups ((1, 2, 3, 4, 5)) = Z5 and ((1, 4, 3, 5)) = Z4 (in particular, it's 
metacyclic), but also G2 \ ((1,2,3,4,5)) U {1} is the union of subgroups which are all isomorphic to 
((1, 4, 3, 5)) (actually they are all conjugates of ((1, 4, 3, 5))) and have trivial pairwise intersections. (In 
this case we say G2 has a "flower" structure.) Second, G4 is the conjugate of G3 by (3,4, 5) in Gi. In 
particular, (1, 3, 4, 2)(3'4,5) = (1,4,5,2) = (1,2,5,4)"^ 

As these subgroups are represented in permutations, it is not easy either to construct a code from 
them, or to extend them to a family of violations. Naturally one may try Sq with similar subgroups, 
but unfortunately they do not work. A better way to extract the structural information and extend the 
subgroups to a family of (possible Ingleton-violating) instances, is through the abstract presentation of 
groups. It might still be difficult to see concrete group elements or to prove the structure is successfully 
extended, however, we can feed the (extended) presentation to GAP and it might determine a concrete 
isomorphic group, which preserves the structure of violation. 

Observe that IG23I = IG24I = 4 contribute most to the RHS of (|3]l, we may try to let the "petals" of 
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G2 

Fig. 1. The cycle graph of the Ingleton violating subgroups of S5 



G2 (conjugates of ((1,4,3,5))) grow while keep other structures fixed. (This is a little conservative, but 
it is the only successful extension according to our GAP trials. For example, one may try to extend Gi 
at the same time, but the structure of G3 and G4 usually collapse.) As G2 plays the most important role 
in the violation, we can start from extending the flower structure of G2. Specifically, we may assume 
that G2 = {a, b) which has a normal subgroup N = (a) = Z„, as well as a subgroup H = (b) = Z^, 
for some generators a, b and integers m, n. This gives us a presentation 

G2 = (a,6|a" = 6'" = l, a^ = a") (5) 

for some < s < n. In order to violate Ingleton as much as possible, we may wish n to be small while 
m large. However, the flower structure of G2 may limit the choices of n and m. First of all, for this 
presentation to be a semidirect product, we need s™ = 1 (mod 7i) (see [16], 5.4). In this case a, b have 
order n, m respectively, \G2 \ = mn, n = 1, s € with \s\ \ m, also (a*)^*" = a**'' for any integers 
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i and k. Moreover, we need G2 \ U {1} to be the union of groups which are all isomorphic to H with 
trivial pairwise intersections. 

One possible way to achieve this is to restrict H^^ n H^^ = 1 V^ii ^ 92 ^ N, as in our original 
construction. This is equivalent to HH = 1, Vr^ € {1}. If this is the case, there would be |A^| = n 
"petals" of size m in G2 and the total number of nonidentity elements would equal n{m — l) = nm — n = 
IG2 \ A^j, so indeed the flower structure would be achieved. 

Pick two arbitrary nonidentity elements /ii = 6' € H, h2 = {h^Y^ G for some < k,l < m, 
< i < n. hi = h2 4^ a'^^d' = U ^ a"* (a*) ^"''6'^ = U <^ a~*a**"'° = h'-'^ ^ a^'*"''^^)* = 6'"*-'. As 
HiryN = 1, this is equivalent to a^''"'""^)* = 6'"'' = 1. i.e. / = k, n\{s~^ - To guarantee H"-'riH = 1 
for any < i < 7?,, we must have m < \s\. Otherwise we can just choose < A: = |s| < m, then = 1 
(mod n) =^ n\{s~^ — l)i for any i, and we find a nonidentity element hi = h^ = h2 = (b^)"'' in H"-' nH. 
So m < \s\ with \s\\m ^ m = \s\. In particular, m < (p{n) < n, where (p{n) = |Z^| is Euler's totient 
function. 

For m to be as large as possible, s should be a primitive root modulo n, which makes m = 4){n). 
Furthermore, if we choose n = p for some prime p > 2, then m = = p—1 is relatively "maximized". 
(We need p > 2 for the petals not to collapse.) Also in this situation if we let < k < m = \s\, 
< i < n = p, then n\{s~'' — requires p\i or pK-s"^ — !). As p is prime, p f i, so p\{s~'' — l) =^ = 1 
(mod p) |s| I A;. But < A; < |s|, contradiction. So actually we have n H = 1, £ N and the 
flower structure is realized. 

Now assume n, m and s are as above. The next step is to extend presentation ([5]) to the whole group 
G generated by Gi — G4. Consider the dihedral groups G3 and G4. The subgroups of rotations are just 
H"-^ and respectively, for some 03 = a^"^ , 04 = a^* G A^. Also G3 and G4 each shares one element 
of reflection with the dihedral group Gi, while the remaining reflection of Gi is just {b~)"-^ in G2, for 
some oi = a^^ G A^. Thus if we can determine the generator of the subgroup of rotations of Gi, then 
all elements of Gi — G4 are determined. In other words, if we introduce an element c as the generator of 
rotations of Gi, then all elements from Gi — G4 can be express as products of a, b, c and their inverses. 
Let's define the following quantities: 

bi = {b'^r'\ bs = b''''\ b, = b''''' (6) 

for some integers ki,k^,k4. Then we can write 

Gi = {c,bi), G2 = {a,b), G3 = {bic^b3), G4 = (610,64), G = {a,b,c). (7) 
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As Gi = Dq, we should have the relation = (cbi)^ = 1. For G3 and G4 to be dihedral groups, we 
need {hbic'^)^ = {b^hcf = 1. We may use GAP to determine a concrete group with these relations, 
but there are still too many parameters to choose and we do not know which ones may yield the correct 
structure. 

Observe in the original violation, the structure G4 = ^3^'^'^^ with generators (1,3,4,2)'^^'^'^) = 
(1, 2, 5, 4)-i is not utilized yet. If we let a = (1, 2, 3, 4, 5), b = (1, 4, 3, 5), c = (3, 4, 5), 63 = (1, 3, 4, 2), 
64 = (1,2,5,4) in the original construction, then the relation above translates to 6§ = We claim this 
relation for our presentation automatically makes (63610^)^ = (64610)^ = 1 if and only if A;3 — A;i = ki — k^ 
(mod p): as = 2, = (cfei)^ = 1 ^ c6i = bic^, (63610^)^ = bsbic^^b^cbi = 636164 61 by the new 
relation. Similarly (64610)2 = 646163^61 = ((6361 c^)-^)^!, so (63610^)2 = 1 <4> (6461 c)^ = 1. Plugging 
in ^ and using (a*)^'' = a^^^ we have 

(63610^)2 = a[{fc3-fci)+{fci-fc4)s<''-^'''^](s-^-i)_ 

Since s is a primitive root modulo p, \s^^~^^^'^ \ = 2. As is cyclic of an even order p — 1, it is clear that 
there is a unique element of order 2. Also |(p — 1)| = 2 as {p — 1)^ = 1 (mod p), so s^'^^^"^ = p — 1, 
and 

(636ic2)2 = a^i^'>-^i)-{ki-k4)]{s-'-i)^ 

Now p \ {s~^ — 1) as |s| = p — 1, then (636102)^ = 1 if and only if p\[{k^ — ki) — {ki — k^)] if and 
only if k^ — ki = ki — k^ (mod p). This condition gives us a smaller set of parameters as well as a 
simpler presentation, while maintains all the structures of the subgroups. (Actually once /C3 — /ci = /ci — k^ 
(mod p) is satisfied, it is very easy to use GAP to produce the desired structures, even with arbitrary ki 
and k^.) 

In sum, our analysis gives us the following presentation: 

G = {a,b,c\aP = 6^"^ = = 1, a'' = a', {cbif = b^b^ = 1) (8) 

where p is an odd prime, s is a primitive root modulo p, k^ — ki = ki — k^ (mod p). If our extension 
of the subgroup structures succeeds, then the orders of subgroups and intersections would be: |Gi| = 6, 
IG2I = p{p-l), IG3I = IG4I = 2(p- 1), IG12I = IG13I = |Gi4| = 2, IG23I = IG24I = P-I, 
1^341 = 1^1231 = IG124I = 1- LHS of ® = Qp{p - 1) while RHS = 8{p - 1)2. So for p > 5, Ingleton 
should be violated. 
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V. Explicit Violation Construction with PGL{2,p) 

Plugging the above presentation into GAP with different p's and other parameters, we get a series of 
groups. However, when p is large, GAP usually runs out of memory for some (even simple) operations. 
According to our computation, for p = 5, 7, . . . , 23 GAP determined that they are all finite groups and 
all violate Ingleton. Among these groups GAP determined their isomorphism types up to p = 19, most of 
which are semidirect products PSL{2, p) x Z2. As PGL{2, p)'s are also semidirect products of PSL{2, p) 
and Z2, and PGL{2, 5) = ^5, we guess the isomorphism type for these groups might just be PGL{2,p). 
This conjecture is verified by GAP up to p = 11. 

Although PGL(2,p)'s are relatively easy groups of matrices, GAP uses isomorphic permutation groups 
to represent them. This makes it difficult to recognize the corresponding matrices of the output subgroups. 
However, with presentation dSjl we may explicitly identify the generators in PGL{2,p) and check their 
relations, then use dV]) to construct the subgroups. 

Let p be an odd prime. For A G GL{2,p), let A denote the left coset of A in GL(2,p) with respect 
to V = {al : a € Fp }. Thus A = B if and only if each entry of A is a nonzero constant multiple 
of the corresponding entry of B. We denote the elements of Fp by ordinary integers, but the addition 
and multiplication, as well as equality, are modulo p. Furthermore, —k and k~^ denotes the additive 
and multiplicative inverses of k in Fp respectively. This would not cause any confusion as we only use 
elements from Fp in the entries of matrices. 



Consider the following matrices in GL(2,p): 





1 







1 







" 1 £^ " 

^ 2 


A = 






, B = 






, c = 






1 


1 







t 




2 



(9) 



where t is a primitive root modulo p, i.e. a generator of Fp. Our guess is A,B,C corresponds to the 
generators o, 6, c in (H) respectively. The powers of these matrices are: 

p- 1 
p- 1 



A>' 



1 







1 




^ 






, B'' = 




^ 2 




k 


1 









2 -1 





for any integer k. Thus Ai' = I, B^ ^ 



I, C = I and \A\ = p, \B\ = p - 1, \G\ = 3. Also 



A^ = B-^AB = 


1 




1 







1 







1 






















t-i 




1 


1 







t 




1 



where s = t~ is also a primitive root modulo p. So yl = A . Next we let 



Bi = {B' 



A-'^'B^A''' 



1 




1 







1 




1 


-ki 1 







-1 




ki 1 




-2ki -1 
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where we calculated t ^ = — 1 as it is the unique element of order 2 in . Now check 

1 



CBi 



1 

2 



1 + 2+1 
2 



-2k^ 



-1 



2 



n 2 



(1 + A:i)2 + 1 (1 + A;i)£±l 
2(1 + A;i) 1 



Thus if we want {CBi) = I, ki must be —1. In this case 





1 




' p±i' 

^ 2 




2^ 

^ 2 


Bi = 


2 -1 


, CBi = 


2 




-2 



, {CBiY = I. 



Next we calculate: 



1 




1 




1 




1 


-k 1 




t 




k 1 




k{t-l) t 


= -1, ks 




ki = ki 




A;4, we 


have /c4 = — 2 — ^3 



B^C B^ 



1 



p-i 



2 

2 



2 



whose (2, 2)-entry is k2,{t - l)^t. If we want (-63)'^' ■ B4 = I B3CB4 = C, k^ must be as the 



1 

kz{t-l) t 

1 

A;3(t-l) + 2t /C3(t- 1)2=1 
c 



1 
ki{t - 1) t 

1 

A;4(t - 1) t 



(2, 2)-entry of C is and all t — 1, 22^, t are nonzero. So ^4 = — 2 — /cs = —2, 




S4 



1 

2(1 -t) t 



B^CB^ 



2 




1 




" t 2_lt" 














= C. 


2t 




2(1 -t) t 




2t 





So far for A,B,C we have verified all the relations in dSjl. We can also prove that they are actually 
a set of generators for PGL{2,p). Observe that each matrix in GL{2,p) can be written as a product of 
the following elementary matrices: 

1 



k 1 



1 k 
1 



1 




t'' 
1 
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which are generated by ^, ^B. So PGL{2,p) is generated by A,A'^,B. Now as = —2 for 

some integer I, = (—2)"^ = We have 





1 




1 




" 1 " 

^ 2 




1 




2^ 


















-2 1 




2 




-2 



1 1 

2 





1 


1 







1 



A' 



Thus A,B,C also generate PGL{2,p). So if we set s = /ci = -1, fcs = 0, A;4 = -2, then A,B,C 
corresponds to the generators in ([8]l. 

Remark 5: Note that we have not proved that ([8]) is a presentation of PGL{2,p). In order to do that, 
one must show that for any group generated by a, b, c while satisfying the relations in (HJ, the order must 
be no more than \PGL{2,p)\ = {p — l)p{p + 1). This is not proved yet. However, identifying possible 
corresponding generators still gives us a way to explicitly construct the subgroups to violate Ingleton. 

Now we can write out the subgroups in PGL{2,p) corresponding to subgroups in (|7]l. 



Gi = {C,Bi). Note that |C| = 3, \Bi\ = 2, (CBiY = I ^ GBi = Bi{G)\ so Gi has at most 6 
elements {{Biy{Cy : < i < 2, < j < 3}. Calculating these elements we can see |Gi| = 6 exactly: 





" 1 " 

^ 2 




^ 

^ 2 


1 


1 




" 1 2^ ' 

^ 2 




^ 

^ 2 


1 




2 




2 -1 




2 -1 




-1 




-2 





G2 = {A, B). We claim that G2 is just the subgroup of lower triangular matrices in GL{2,p) modulo 
V, i.e. 



Go 



1 

a (3 



As A, B are lower triangular, any element in G2 is a lower triangular matrix modulo V. On the other 
hand, Va G Fp, /3 G F^ , /? = for some integer So 



1 

a (3 



1 

a (3 



A"B^ G G2. 



Therefore IG2I = p{p — 1) 



G3 = {Bi{Cy,B3) = {CBi,B-i). Note that \CBi \ = 2, [Sgl = [S] = p- 1, also 



S3 • CSi 



1 












£^ 
2 




" 2^t-i 





t 




-2 




-2t 




-2 



CBi{B^r', 
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SO G3 has at most 2{p - 1) elements {{CBiY^Bsy : < i < 2, < j < p - 1}. Calculating these 



elements we can see IG3I = 2(p — 1) exactly: 



1 

t^' 



Ci?i(i33)' 



^t'' 
-2 



: 0<k <p-l} . 



G4 = {BiC,Bi). Note that 



B^C 



1 £^ 
-1 



1 
2(1 - t*^) t'^ 



so \BiC\ = 2, |54| = p - 1. Also 



i?4 • BiC 



1 



p-l 



2(1 -t) -1 



2(t-i - 1) -i-i 



" 1 Pul ' 




1 


= i?lC(i?4)~' 






2(1 -t-i) t-i 


-1 







so G4 has at most 2(p - 1) elements {{BiCYiB^y : < i < 2, < j < p - 1}. Calculating these 
elements we can see IG4I = 2(p — 1) exactly: 



Ga = < 



(Ba)' 



1 

2(1 - t*^) t'' 



, BiCiBi) 



2 



2(1 -t-'^) -1 

With all four subgroups explicitly written, we can easily write down the intersections: 



0<k <p-l 







1 


1 


Gl2=< 




2 -1 





Gl3= <^ 



Gu={ 



G23 — ' 




IG12I = 2. 



, 1^131=2. 



, IG14I — 2. 



: 0<k<p-l}, jG23|=p-l. 




G24 — ' 



1 

2(1 -i'^) t'' 



: 0<k <p-l} , IG24I =p-l. 
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G34 — Gi23 — G124 — 1- 

So in ©, indeed = IG1IIG2IIG34IIG123IIG124I = 6p(p- 1), = IG12IIG13IIG14IIG23IIG24I = 

8{p — 1)^, LHS — RHS = 2{p — 1)(4 — p). Thus Ingleton is violated when p > 5, and the subgroup 
structures of S5 are exactly reproduced. 

VI. Conclusion 

Using a refined search we found the smallest group to violate the Ingleton inequality to be the 120 
element group ^5. Investigating the detailed structure of the subgroups allowed us to determine that 
this is an instance of the Ingleton-violating family of groups PGL{2,p) for primes p > 5. We have 
begun investigating PGL{2,p'^) groups and conjecture that they violate Ingleton for large enough p 
and q. Computer search verities that PGL(2,2^) does not violate Ingleton, whereas PGL{2,2^) and 
PGL{2, 3^) do. Finally, investigating the use of these groups to construct network codes more powerful 
than linear ones may be a fruitful direction for future work. 
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